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ABSTRACT 



The U.S. Army uses a combat simulator, Janus(A), to simulate high-tech ground 
battle exercises. The algorithms used to represent battlefield behavior and to generate 
battle scenarios must be calibrated by well-trained, combat-experienced technicians. The 
calibration is time-consuming and subject to human errors. A Single Exercise Analysis 
System (SEAS) is under development for automating and improving the battle scenario 
generation process for Janus(A). A neural network based model has been proposed to 
support the route determination process within SEAS. The purpose of this thesis is to (1) 
determine the best neural network architecture for determining tank routes and (2) develop 
a prototype for generating these routes. 
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I. 



INTRODUCTION 



A. PURPOSE 

A neural network based route generation process is 
proposed to improve the performance of scenario generation for 
the Army's Janus (A) combat model. More specifically, when the 
quality of data permits, this process will automate processes 
currently performed manually. Eventually, a finished version 
of this prototype will be integrated with a Single Exercise 
Analysis System (SEAS) under development. 

There are two primary purposes for this thesis. First, to 
determine the best neural network architecture for determining 
tank routes. Second, to develop a prototype for generating 
these routes . 

B . BACKGROUND 

The U.S. Army utilizes Janus(A), a combat simulator, to 
emulate the complex reality of high-tech ground battles or 
battle exercises. This model is equipped with algorithms that 
represent battlefield behavior in typical combat situations. 
This combat simulator provides calibration mechanisms for 
adjusting simulation parameters to allow for various battle 
contexts that might occur. This calibration must be performed 
by an analyst who is well-trained and experienced in combat. 
In addition, he must be familiar with the combat simulator. 
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This calibration is time-consuming, subject to human errors 
and may not be complete (Tversky and Kahneman, 1974) . 

A neural network algorithm is proposed to perform the task 
of generating tank routes for training and evaluation and 
training. This is proposed to seek a behavioral rather than 
analytical representation of the tanks in a battlefield. It is 
also an effort toward using machine learning techniques for 
analyzing actual combat behaviors. This neural network will 
capture actual successful routes of tank commanders who were 
confronted with evolving combat simulations. This algorithm 
will then be used to predict the movement of a tank given its 
initial position. 

C. ORGANIZATION OF THE THESIS 

The thesis is organized as follows. Chapter II provides 
an overview of the route determination process and of using 
neural networks for route determination. Chapter III 
describes the search for the best network architecture for 
route generation and the results of the search. Chapter IV 
presents the prototype for route determination. The summary 
of findings and recommendations for further research is 
provided in Chapter V. 
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II. OVERVIEW OF USING NEURAL NETWORKS FOR ROUTE DETERMINATION 



A. TANK ROUTE DETERMINATION PROBLEM 

According to the U.S. Army doctrine (USA-FM17-15, 1987), 

a tank commander should determine his route based on the 
following major principles: 

• Follow the route determined by the concept of operation. 

• Employ unit movement techniques and drills to balance 
speed with likelihood of enemy contact. 

• Use the terrain and natural or man-made cover and 
concealment to mask his weapon system from enemy 
observation . 

It is expected that trained troops will follow as close as 
possible the concepts of engagement laid out by high-level 
command. However, factors on the battlefield may require 
significant departures from company commander's intent and 
execution plan. Factors governing a tank commander's movement 
include his position, route, enemy's position, and his 
vulnerability . 

Route determination is a dynamic, real-time reasoning 
process with incomplete and possibly inexact information. As 
a battle unfolds, each time slice can be perceived by the tank 
commander as a life-threatening crisis that forces him to 
reevaluate his next movement. (Bui et al . , 1992) 
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B. OVERVIEW OF ROUTE DETERMINATION TECHNIQUES 

As a decision problem, there are at least three approaches 
or techniques that can be used to determine routes. These are 
a mathematical model approach, a heuristic approach and a data 
inductive approach. 

A mathematical model approach would attempt to consider 
all relevant factors that lead to the determination of a 
route. Once these factors are determined and required data 
gathered, models would be developed for determining routes. 

A heuristic approach would try to harness the knowledge of 
experts. In our case, an expert platoon commander's knowledge 
would form the basis of an automated expert system that could 
be used to determine routes. This requires gathering an 
expert's expertise in some way and then modeling and coding 
this knowledge. The resulting expert system could 
theoretically be used to determine tank routes. Such expert 
systems have been applied in the field of medical science, for 
example. These systems support medical personnel decision 
making . 

The data inductive approach conjectures that, in some 
complex situations such as the route determination process, it 
would be impossible to model all direct causal relationships 
due to incomplete, uncertain and dynamic information. To 
circumvent the difficulty in applying analytical reasoning 
using quantitative algorithms, the inductive approach 
hypothesizes that there is a lot to learn from those tanks 
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that successfully make it though to their planned destination. 
Neural networks are the form of inductive approach we have 
chosen as the subject of this thesis. 

C. USING NEURAL NETWORKS FOR ROUTE DETERMINATION 
1. A Brief Description of Neural Networks 

A neural network is a system consisting of several 
simple, highly interconnected homogeneous processing units 
called neurons (Figure 1) . Each neuron is a simple 
computation device that continuously reacts to external 
inputs. Typically, a neuron receives input signals from other 
neurons, aggregates these signals based on an input function, 
and generates an output signal based on an output function or 
transfer function. A weighted directed graph represents the 
interconnection of the neurons. Nodes represent neurons and 
links represent connections. The weight assigned to the link 
between two neurons represents the relative importance of that 
link . 

The crucial problem in training neural networks is 
determining a set of weights assigned to the connections that 
best maps all input units to their corresponding output units. 
In other words, the learning process can be seen as a non- 
linear optimization problem that minimizes output differences. 
The back-error propagation technique is probably the most 
widely used algorithm for minimizing the output differences. 
(Bui et al . , 1992 ) 
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INPUT NEURONS HIDDEN OUTPUT NEURONS 

NEURONS 



LEGEND: Wlj , Wjk : Connection Weights 



Figure 1. Neural Network Architecture 
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The back-error propagation technique iteratively 
assigns weights to connections, computes the errors between 
outputs and target outputs, propagates this error information 
back, layer by layer, from the output units to the input 
units, and adjusts the weights until errors are minimized. 
The back-error propagation technique does not guarantee an 
optimal solution. However, various experiments reported by 
Rumelhart et al . (1986) and by other researchers (Maren et 
al., 1990; Freeman, 1991) suggest that the algorithm provides 
solutions that are close to the optimal ones. 

2. Advantages of using Neural Networks for Route 

Determination 

As stated previously, the idea of using neural 
networks for route determination is based on the hypothesis 
that there is a lot to learn from those tanks that 
successfully made it through to their planned destination. A 
neural network trained to actual routes should be able to 
produce routes that simulate the dynamic movements of actual 
tank routes. These routes are derived without any detailed 
knowledge of how the actual routes used for training had been 
chosen . 

3 . An Example 

After a battle exercise is conducted at the National 
Training Center, Ft. Irwin, those tanks that reached their 
destination are considered successful. For this exercise, 
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their mission was to reach a destination located approximately 
9 kilometers North-East of their initial position. As these 
tanks moved toward their goal they would make contact with the 
opposing force. Nineteen tanks were successful and their 
routes were used to train the network model . 

Forty- two coordinates, taken at five-minute intervals, 
represent the route of each tank. Each route begins with a 
point of departure and the destination point. The coordinates 
are x and y coordinates on the training area grid. 

After training the network model, it can be used for 
generating routes from any feasible start coordinate. For 
example, an x coordinate of 43900 and a y coordinate of 96225 
may be used as input to the model. The model will generate a 
coordinate, such as 44250, 98475, that it predicts is the next 
coordinate in the route. This coordinate will be used as 
input and another coordinate will be generated. Eventually, 
an entire route will be generated in this manner. 

D. ISSUES RELATED TO USING NEURAL NETWORKS 
1. Architecture 

A neural network architecture refers to how the 
neurons are connected to each other and what kind of neurons 
they are. Typical neural networks are designed in layers of 
neurons . Each layer is a group of neurons that share a 
functional feature. The network used for route determination 
has three layers. The first layer, the input layer, has the 
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task of taking in the route data, in our case this is a tank 
position. The second layer, the hidden neuron layer, uses the 
output from the first layer to calculate its output to the 
third layer. The third layer, or output layer, has the task 
of producing an output; the next tank position. Figure 2 
illustrates how a neural network architecture for determining 
tank routes might appear graphically. 

Part of the task of designing the network architecture 
is determining the number of neurons included in each layer. 
The data available for successful tank routes include: the 
tank designation (unit number) , time of position (every 5 
minutes), the x and y coordinates of the tank and the next x 
and y coordinates of the tank (see Appendix A for a complete 
printout of the data) . From this data it is necessary to 
decide which data is significant for the network. Table 1 
presents an example of the data available for this research. 

TABLE 1. EXAMPLE OF RESEARCH DATA 



Time 


Unit No. 


X Coord. 


Y Coord. 


Next 
X Coord. 


Next 
Y Coord. 


60 


42 


43900 


96225 


44250 


98475 


65 


42 


44250 


98475 


45788 


98500 



Since we desire to produce a route that is a series of 
positions, the network needs the x and y coordinate data. The 
network does not need to know tank designations so that data 
is not used as an input. 
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Figure 2. Neural Network Architecture for Tank Routes 
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When a network trains, it looks at the x and y 
coordinates and predicts the next x and y coordinates. Since 
the next x and y coordinates are 5 minutes into the future, 
that fact can be considered implicit. Because time is 

implicit in the coordinate data, it is not necessary to 
include time explicitly as an input to the network. This 
narrows the inputs to the neural network to the x and y 
coordinates. The input layer will have two neurons, one 
representing the x coordinate and one representing the y 
coordinate . 

We want the network to predict the next x and y 
coordinates when given a current x and y coordinate. 
Therefore, the output layer will consist of two neurons 
representing these coordinates. 

It is not as simple to determine the number of neurons 
in the second, hidden, layer. Because hidden neurons are 
necessary for the network to perform its calculations, having 
too few neurons in the hidden layer will cause the network not 
to train at all . Because increasing the neurons adds to the 
complexity, too many neurons may mean slower training and 
running (California Scientific Software, 1990). California 
Scientific Software, the maker of our neural network tool, 
BrainMaker, suggests using the average of the input and output 
neurons as the number of hidden neurons. If this number is 
less than 25, they suggest some undetermined number more than 
the average. They suggest that complex problems such as 
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problems with hundreds of facts may require more hidden 
neurons while straightforward or linear problems tend to 
require fewer. Our problem is both straight forward (given a 
coordinate produce the next coordinate) and has hundreds of 
facts (42 coordinates in an average route and a set of 19 
routes) . Determining the optimum number of neurons is a major 
portion of the research for this thesis. 

We added network training percentage to what is 
commonly considered the architecture of the neural network. 
Training percentage refers to the number of predictions a 
network must get correct to complete training. When training, 
the x and y coordinates are the inputs and the next x and y 
coordinates are the output patterns with which the network 
will compare its predictions. The network considers its 
prediction correct when it falls within the training tolerance 
of .100 (10 percent). For example, a network will consider 
its prediction correct if it predicts 45000 - 95000 (x and y 
coordinates) and the output patterns are 49400 - 95500. We 
quickly discovered that it is not possible to train our 
networks to 100 percent. 

In a set of training data (also called training facts) 
there may be some data that exhibit unusual patterns. For 
example, consider that an entire platoon is progressing over 
the terrain but one tank has a problem and stops for 2 0 
minutes. That only one tank is not progressing for some 
period will not make sense to the network. When the tank 



12 



recovers and proceeds to catch up at a rapid pace, the network 
may not understand that behavior. The network may be unable 
to predict the next x and y coordinates for the tank during 
these periods since its behavior does not correlate with that 
of other tanks. Since such situations may not make sense to 
the training program it may not be possible to train this 
network to 100 percent. In fact, it is not possible to train 
our network to 100 percent given the route data used during 
our research. We needed to determine what network training 
percentage would allow the network to train and not degrade 
the network's prediction accuracy. 

2 . Accuracy 

Initially, accuracy simply seems to mean "How close 
are predicted x and y coordinates to the actual x and y 
coordinates?". However, we found that any of the networks 
that train, despite the number of neurons, very accurately 
predicted next x and y coordinates when presented with an 
actual x and y coordinate. This makes sense because, to 
successfully train, a network must predict the next x and y 
coordinate to within a 10 percent tolerance of the output 
pattern. Therefore, we expanded accuracy to mean "How close 
to the generic, or average tank route, is a predicted tank 
route?" In other words, we give a network start coordinate 
and the network produces the next coordinate. We then give 
the network this coordinate and it produces the next 
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coordinate, and so on until the network will no longer produce 
a different coordinate. We then compare this series of 
coordinates (which comprise a route) to the generic (average) 
tank route to determine how closely the predicted route 
follows the average route. 

Initially, our basis for judging the routes consisted 
of whether the route generally followed the path of the 
average route. Eventually, the number of coordinates in the 
route (representing the average speed of advance) became an 
additional criterion. 

3. Ability to Handle Unexpected Start Positions 

Also included in the testing was how the network 
handled unexpected start positions . These include such as 
those located in terrain that is not traversable by tanks. 
Would the network try to recover by proceeding to possible 
positions or would it just be unable to predict a route? 
Impossible start positions are primarily a theoretical problem 
since the intended eventual uses of the proposed route 
prediction system will have no reason to propose an impossible 
start position. Yet, a somewhat unexpected start position may 
be possible and the ability of the network to handle this is 
important . 
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III. SEARCHING FOR AN APPROPRIATE NETWORK ARCHITECTURE 



A . METHODOLOGY 

1 . Changing the Number of Hidden Neurons 

As stated previously, the makers of BrainMaker 
recommend the average of the input and output neurons as the 
number of hidden neurons unless this number is less than 25. 
The average is two and, although significantly less than 
twenty-five, we used two hidden neurons as the start. From 
that we decided to try 4, 6, 8, 10, 12, 15, 20, 25, 30, 35, 
40, 45, 50, 60, 70, 80, 90 and 100 or until it was obvious 
that increasing the number of hidden neurons was not going to 
increase the accuracy of the network. These choices were 
arbitrary, but incrementally representative, since we felt 
that increasing hidden neurons by 1 until 100 would be 
prohibitively time consuming and unnecessary. If it appeared 
that using 20 hidden neurons produced better routes than those 
produced with 15 and 25 hidden neurons then we would try 
varying hidden neurons around 20 to determine the optimum 
number. Eventually, we did train some networks using 
different numbers of hidden neurons not on our initial list. 
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2. Testing the Accuracy of Trained Networks 

Initially, we put the network predicted coordinates 
and the output patterns into a spreadsheet and determined the 
average of the differences between them. We had hoped that 
the best network would have the smallest average differences. 
Although there were ranges from an average of 4 yards 
difference to 244 yards difference, these are not significant 
when talking about numbers such as 33,000 to 120,000. Also, 
the larger differences did not suggest any sort of trend. In 
other words, we found that using 20 hidden neurons produced 
average differences of 4 yards and using 70 hidden neurons 
produced average differences of 244 yards suggesting that 
networks with fewer hidden neurons produce more accurate 
predictions. On the other hand, we found that using 60 hidden 
produced differences of 13 yards and using 15 hidden produced 
differences of 121 yards which suggests that networks using 
more hidden neurons produce better predictions. Obviously, 
this method of evaluation is ineffective and probably 
meaningless (as discussed earlier) . 

We determined that evaluating the network performance 
visually (by comparing graphs of predicted routes with graphs 
of actual average routes) was the best method. Since we want 
routes that are feasible and generally reflect the behavior of 
successful routes, this method provides us with the means to 
evaluate these characteristics . 
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We used a generic tank route (Figure 3) for 
comparison. This route consists of coordinates that are the 
average of the position of the tanks in the training data at 
each particular time. For example, the first coordinate is an 
average of each tank's position at time 0 and represents the 
average start coordinate. The terrain (Figure 4) of the 
training area is such that some areas are inaccessible for the 
tanks. We used this graph to determine if generated routes 
avoided these areas as well. 

We generated routes from each trained network from the 
generic route's average start coordinate (34135 - 97327) and 
visually compared them to the generic route. We visually 
compared the generic and generated routes to find how much 
they resembled each other. We also verified that the 
generated routes avoided the inaccessible terrain. 

3 . Training Time 

We expected the training time to increase as we 
increased the number hidden neurons. We felt that the time it 
takes to train a network would become an important factor as 
we increased the number of hidden neurons. We felt there 
might be a point where increasing the hidden neurons (and, 
theoretically, the training time) might not increase the 
accuracy of the network enough to justify the increase in 
training time. Therefore, we considered training time while 
evaluating networks. 
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Y COORDINATES 
(Thousands) 



120 




(Thousands) 



LEGENDp* : INDICATES DIRECTION OF MOVEMENT 
MARKS ON ROUTE INDICATE POSITION AT 5 MINUTE INTERVALS 



Figure 3. Generic Tank Route (Average of Original Routes) 
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(Thousands) 

LEGENCQ : IMPASSABLE TERRAIN 



Figure 4 . Terrain of Ft. Irwin Training Area 
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4. Unexpected Start Positions 



Once we narrowed the networks down to the best three, 
we further evaluated them with unexpected start positions. We 
felt that it be the final factor in determining the "best" 
network architecture for predicting tank routes. 

We chose three test positions. The first, 40000 - 
105000, is within the vicinity of the destination, but south 
of any of the original routes. The second two, 42000 -110000 
and 57000 - 102000, are located within hilly terrain 
considered impassable. We chose these points to evaluate 
whether the network might "recognize" this terrain as 
impassable and try to take a quick route to familiar 
territory, proceed directly to the destination area, or be 
unable to produce a route. 

5. Summary of Training and Evaluation Procedure 

It was evident that it would be prohibitively time 
consuming to try to train every network while varying the 
training percentages from 100 percent to 90 percent (for 
example) . The first step was to find a test percentage that 
would allow the network to train and to train in a reasonable 
period without noticeably depreciating the performance. In 
view of the possible eventual use of a route prediction 
system, we considered 5 hours to be the maximum amount of time 
to be reasonable and hoped to get training times to within an 
hour. To do this, we decided to use a test network with 10 
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hidden neurons and to train and evaluate it (not in detail) 
when trained at varying training percentages. 

As expected, at 100 percent the network would not 
train at all. Again at 99 and 98 percent, the network would 
not train within 5 hours. At 97 and 96 percent, training time 
dropped to between 1 and 2 hours. At 95 percent, training 
took 22 minutes and 50 seconds and training time took much 
less as we lowered the training percentage. There were almost 
no differences in the routes produced by the networks trained 
to 97, 96 and 95 percents. Networks trained to percentages 
less than 95 percent produced routes which differed 
noticeably . 

It seems safe to assume that networks trained to a 
higher percentage should be more accurate. We also believe 
that a time of less than 30 minutes would be very acceptable 
for our purposes (in fact, training time will drop on faster 
hardware) . Since there was a perceptible difference between 
those networks trained to less than 95 percent and those 
trained to 95 percent and above, we decided to train our 
networks to 95 percent for this research. 

Once we established our training percentage, we 
proceeded to train networks with the various numbers of hidden 
neurons described previously. After completion of training, 
we evaluated the attributes of training time, accuracy and 
handling of unexpected start points as described in the 
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previous sections. Figure 5 graphically illustrates the 
evaluation process. 

B . RESULTS 

1 . Changing the Number of Hidden Neurons 

Networks were trained with the following numbers of 
hidden neurons: 2, 4, 6, 8, 10, 12, 15, 20, 25, 30, 35, 40, 
45, 50, 60, 70, 80, 90 and 100. After evaluating each 

network, we trained networks using 7, 9, and 11 hidden neurons 
to fine tune the analysis. 

2. Testing the Accuracy of Trained Networks 

We eliminated several networks after visually 
comparing the routes they produced. Some networks could not 
produce a complete route even when started with the average 
start coordinate. For example, the networks using 2 and 15 
hidden neurons both failed after generating 6 to 10 
coordinates of a route (Figures 6 and 7) . Some networks 
produced routes that behaved like the successful tanks only in 
a very broad way, meaning that they generally started south- 
west like the generic route and eventually ended near the 
generic route's end coordinate. The route generated by the 
network with 20 hidden neurons (Figure 8) is an example. Some 
networks (like the network with 25 hidden neurons) produced 
routes that appeared to behave quite differently from the 
generic route although generally ending near the generic end 
coordinate (Figure 9). 
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Figure 5. Diagram of Evaluation Process 
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LEGENDp* : INDICATES DIRECTION OF MOVEMENT 



Figure 6. Route Generated by Network with 2 Hidden Neurons 
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Figure 7 . Route Generated by Network with 15 Hidden Neurons 
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Figure 8. Route Generated by Network with 20 Hidden Neurons 



26 



Y COORDINATES 




(Thousands) 



LEGEND: : INDICATES DIRECTION OF MOVEMENT 

X : COMPARISON (GENERIC) ROUTE 
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Figure 9. Route Generated by Network with 25 Hidden Neurons 
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As stated previously, visual comparison eliminated 
most of the networks from further consideration. Those 
trained with 8, 10 and 12 hidden neurons merited further 
consideration . 

a. Testing with an Architecture of 8 Hidden Neurons 

This network produces a route that is very good 
visually (Figure 10) . In other words, it closely follows the 
generic tank route's path and ends very near to the average 
end coordinate. This route follows the path of the generic 
route more closely than the others. 

Closer inspection shows that it contains 30 
coordinates compared to the original tank route's 42. This 
suggests a much more rapid speed of advance than the original 
tanks. A tank travelling as predicted by this network would 
reach its destination 60 minutes earlier than the original 
tanks. This suggests that, although producing a visually 
acceptable route, this route does not closely follow the 
original tanks' average speed of advance (the generated tank 
route is 29 percent faster) . 

The performance of this network prompted us to try 
a network with 7 hidden neurons as well. This network (Figure 
11) produces a route that is almost identical with that of the 
network with 8 hidden neurons. It also has 30 positions which 
suggests the faster speed of advance. 
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Y COORDINATES 
(Thousands) 




(Thousands) 



LEGEND: : INDICATES DIRECTION OF MOVEMENT 

X : COMPARISON (GENERIC) ROUTE 
+ : NETWORK GENERATED ROUTE 

EACH MARKER ON ROUTE INDICATES POSITION AT 5 MINUTE INTERVALS 



Figure 10. Route Generated by Network with 8 Hidden Neurons 
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Y COORDINATES 
(Thousands) 




(Thousands) 



LEGEND: ^ : INDICATES DIRECTION OF MOVEMENT 

X : COMPARISON (GENERIC) ROUTE 
+ : NETWORK GENERATED ROUTE 

EACH MARKER ON ROUTE INDICATES POSITION AT 5 MINUTE INTERVALS 



Figure 11. Route Generated by Network with 7 Hidden Neurons 
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b. Testing with an Architecture of 10 Hidden Neurons 

This network also produces a route that is very 
good visually (Figure 12). It contains 38 coordinates 
compared to the original 42 suggesting that this tank would 
reach the final destination just 20 minutes earlier than the 
original tanks. Although this is not an exact replication of 
the actual tanks' speed of advance, it was the nearest of all 
the networks. It is just 9.7 percent faster than the average. 

Since this network generated a very acceptable 
route, we trained networks with both 9 and 11 hidden neurons 
to find if either of those produced better routes. The route 
generated by the network with 9 hidden neurons (Figure 13) is 
also very good visually, however it contains only 31 
coordinates suggesting a much more rapid speed of advance. 
The route generated by the network with 11 hidden neurons 
(Figure 14) is only fair visually and has just 21 coordinates. 
We determined that to be unacceptable. 

c. Testing with an Architecture of 12 Hidden Neurons 

This network also appeared to be acceptable 

initially (Figure 15). However, the speed of advance is 
extremely fast. This route contains just 24 coordinates 
indicating an average speed of advance 43.9 percent more rapid 
than the actual tank routes. 
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Y COORDINATES 
(Thousands) 




(Thousands) 



LEGEND: ^ : INDICATES DIRECTION OF MOVEMENT 

X : COMPARISON (GENERIC) ROUTE 
+ : NETWORK GENERATED ROUTE 

EACH MARKER ON ROUTE INDICATES POSITION AT 5 MINUTE INTERVALS 



Figure 12. Route Generated by Network with 10 Hidden Neurons 
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Y COORDINATES 




(Thousands) 



LEGEND: ^ : INDICATES DIRECTION OF MOVEMENT 

X : COMPARISON (GENERIC) ROUTE 
+ : NETWORK GENERATED ROUTE 

EACH MARKER ON ROUTE INDICATES POSITION AT 5 MINUTE INTERVALS 



Figure 13. Route Generated by Network with 9 Hidden Neurons 
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Y COORDINATES 
(Thousands) 




(Thousands) 



LEGEND: ^ : INDICATES DIRECTION OF MOVEMENT 

X : COMPARISON (GENERIC) ROUTE 
+ : NETWORK GENERATED ROUTE 

EACH MARKER ON ROUTE INDICATES POSITION AT 5 MINUTE INTERVALS 



Figure 14. Route Generated by Network with 11 Hidden Neurons 
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Y COORDINATES 
(Thousands) 



120 




(Thousands) 



LEGEND: 



: INDICATES DIRECTION OF MOVEMENT 
X : COMPARISON (GENERIC) ROUTE 
+ : NETWORK GENERATED ROUTE 



EACH MARKER ON ROUTE INDICATES POSITION AT 5 MINUTE INTERVALS 



Figure 15. Route Generated by Network with 12 Hidden Neurons 
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After comparison with the other networks, this 
network was clearly not the best. We did not train a network 
with 13 hidden neurons. 

d. Discussion 

All the networks we trained with various numbers 
of hidden neurons produce routes except the two mentioned 
previously (those with 2 and 15 hidden neurons) . Yet, most 
were obviously not good predictors or replicators of the 
actual routes. For example, those trained with 20 and 25 
hidden neurons produced routes that were not very good 
replications and had an extremely slow average speed of 
advance (refer to Figures 8 and 9). After comparing all the 
routes, we narrowed the possibilities to those discussed in 
the previous three sections. 

Initially, we had only planned to compare the 
routes visually, but we noticed that one of the major 
differences between routes was the number of coordinates. It 
became a major evaluation factor since it seems obvious that 
a tank's average speed is an important behavior. The route 
produced by the network with 8 hidden neurons followed the 
generic route's path most closely. Yet, the route produced by 
the network with 10 hidden neurons also followed the path of 
the generic route closely and was the closest in average speed 
of advance. The network with 12 hidden neurons was clearly 
the inferior of the three. 



36 



3 . Training Time 

Although the BrainMaker documentation indicated that 
using more hidden neurons will tend to cause the network to 
train slower, we found that this was not necessarily the case. 
As we increased the number of hidden neurons from 2 to 10, the 
training time also increased. However, training time dropped 
significantly at 15 hidden neurons. The training time for 
this network was 2 minutes and 48 seconds, but, as explained 
in the previous section, this network was unable to generate 
a route. This fact suggests that increasing the hidden 
neurons will not always increase the training time. Table 2 
presents the training time for some selected networks. 



TABLE 2 . NETWORK TRAINING TIMES 



Hidden Neurons 


2 


8 


10 


12 


15 


100 


Training Time 


7:19 


13:53 


22:50 


7:54 


2:48 


4:56 



Table 2 is a representative sample of the observed 
training times . Training times did not increase as hidden 
neurons increased. For example, the network with 100 hidden 
neurons trained in just 4 minutes and 56 seconds. These times 
suggest that the number of hidden neurons may not be the 
factor in training time we expected at all. Of course, the 
number of hidden neurons may be a significant factor in 
training time for other problems. 
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We determined that training time was not a significant 
evaluation factor. Although the training time for the network 
with 10 hidden neurons was longer than those of the other 
networks, it is not sufficiently longer to eliminate it from 
consideration as the best network. 

4. Unexpected Start Positions 

We used the three start positions discussed previously 
(40000 - 105000, 42000 - 110000 and 57000 - 102000) to 
generate routes with all three of the final networks. 
Although the network with 12 hidden neurons is clearly not the 
best of the three, we felt that it would be interesting to 
include it in this evaluation process for comparison. 

We expected the best network to produce routes that 
clearly led out of the impassable terrain to safe terrain when 
presented with the first two start positions . We also 
expected the networks to recognize the third start position in 
the vicinity of the destination area and to produce a route 
that leads to the path of the generic route and on to the 
goal . 

a. Testing with and Architecture of 8 Hidden Neurons 

Figure 16 shows the routes generated by the 
network with 8 hidden neurons. Both of the routes originating 
from the first two start positions lead generally to the safe 
terrain and on to the goal. The route originating from the 
third start position quickly moves toward the generic route 
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Y COORDINATES 




(Thousands) 



LEGENDh# : INDICATES DIRECTION OF MOVEMENT 
+ : 40000 - 105000 START POSITION 
x : 42000 - 1 10000 START POSITION 
* : 57000 - 102000 START POSITION 



Figure 16. Routes Generated by Network with 8 Hidden Neurons 
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and on to the goal. We noticed that the rate of advance is 
very fast from the first two start positions and the routes 
traverse across the hilly terrain instead of leading more 
directly to the safe terrain. 

b. Testing with an Architecture of 10 Hidden Neurons 

These routes (Figure 17) are very interesting. 

The routes originating at the first two start positions lead 
very directly to the safe terrain. These routes then appear 
to follow the path of the route produced from the average 
start position on to the goal. This network appears to 
strongly "recognize" the hilly terrain and to try to take a 
direct route to safe terrain. The route originating from the 
third start position behaved as expected and behaved very 
similarly to the route generated by the network with 8 hidden 
neurons. The speed of advance for all three routes closely 
follow that of the route this network produced from the 
average start position. 

c. Testing with an Architecture of 12 Hidden Neurons 

As expected the routes produced by this network 
(Figure 18) were the poorest. This network clearly 
"recognizes" the goal and produced routes from all three start 
positions that lead very directly to that goal. It clearly 
does not recognize the hilly terrain and completely ignores it 
while travelling to the goal. The speed of advance of these 
routes is extremely fast. 
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Y COORDINATES 




(Thousands) 



LEGENDbb* : INDICATES DIRECTION OF MOVEMENT 
+ : 40000 - 105000 START POSITION 
x : 42000 - 1 10000 START POSITION 
* : 57000 - 102000 START POSITION 



Figure 17 . Routes Generated by Network with 10 Hidden Neurons 
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Y COORDINATES 




(Thousands) 



LEGENDm* : INDICATES DIRECTION OF MOVEMENT 
+ : 40000 - 105000 START POSITION 
x : 42000 - 1 10000 START POSITION 
* : 57000 -102000 START POSITION 



Figure 18. Routes Generated by Network with 12 Hidden Neurons 
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d. Discussion 



The network with 10 hidden neurons appears to 
perform best when presented with unexpected start positions. 
The network with 8 hidden neurons also performs well. 
However, we believe this route to be inferior because of its 
rapid speed of advance and because its routes travel through 
the hilly terrain rather than leading more directly to safe 
terrain . 

C. SUMMARY OF FINDINGS 

The networks with 8 and 10 hidden neurons were clearly 
superior to the network with 12 hidden neurons. Of the 
former, the network with 8 hidden neurons most closely follows 
the generic route. However, the network with 10 hidden 
neurons also follows the generic route very well and most 
closely replicates the average speed of advance. This network 
also handles the unexpected start positions best. We believe 
that the difference in training times is insignificant. These 
facts lead us to the conclusion that the network with 10 
hidden neurons is the best for route determination. 

Given the training data for this research, the network 
architecture required for producing the most accurate routes 
is clear. The network will consist of 3 layers with the input 
and output layers both consisting of 2 neurons and the hidden 
layer consisting of 10 hidden neurons. The network is to be 
trained to 95 percent. 
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IV. A PROTOTYPE FOR ROUTE DETERMINATION 



A . REQUIREMENTS 

As part of the SEAS development, data used for training a 
network will be presented in a DOS text file for use by this 
prototype. The data will only contain the information that is 
relevant; x and y coordinates and the next x and y coordinates 
for each tank's successful route. The data is changed to 
represent the coordinates in thousands. For example 55678 
will be 55.678. This is because the BrainMaker program is 
more efficient when dealing with these numbers than with the 
full numbers. Following is an example of two lines of data 
from this file: 



TABLE 3 . EXAMPLE NETWORK TRAINING DATA 



X Coordinate 


Y Coordinate 


Next X Coord. 


Next Y Coord. 


51.675 


100.150 


51.863 


101.050 


51.863 


101.050 


52.275 


102.150 



Other requirements are an MS-DOS computer, the BrainMaker 
program (not provided) and the prototype files. 

B . PROTOTYPE ARCHITECTURE 

We used a combination of the BrainMaker software, batch 
files and a program written in Ada to create a prototype of a 
system that can be used to generate tank routes. Figure 19 
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Figure 19 . Logical Diagram of Prototype 
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diagrams the prototype's route generation process. The 
operating instructions for the prototype are included in 
Appendix B. The prototype files are available from Professor 
Bui on request. 

We developed the prototype on an MS-DOS 386SX-16MHz 
Personal Computer. The training and route generation times 
will vary with the computer hardware. 

C. A SAMPLE RUN OF THE PROTOTYPE 

Once the data from an actual exercise is gathered and 
formatted in a DOS text file, the user can begin the process 
of training a network and generating routes. The user must 
have the BrainMaker and Netmaker program files, the exercise 
data file and the prototype batch and program files in the 
same directory on a MS-DOS computer. 

The first step in this process is to create a BrainMaker 
Definition file which will be used to train a network. To do 
this the user will start the program Netmaker by typing 
"NETMAKER filename" where filename is the name of the 
exercise data file. Once the program starts, the user will 
see the exercise data that will form the basis of the 
BrainMaker Definition file. The user will classify the first 
two columns as "basis" columns and the next two columns as 
"result" columns (the first two columns represent the 
"present" x and y coordinates while the next two columns 
represent the x and y coordinate after 5 minutes) . The next 
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step is to save the definition file as " brainrts . def . " The 
user will then choose the “Go to BrainMaker" option from the 
menu displayed. 

Once BrainMaker is running, the user will set the training 
percentage to 95 percent and select "train network" from the 
menu. After the network is trained, the user will save the 
network as " brainrts . net . " The user now has a network trained 
and ready for use. 

To generate routes, the user will start the network 
generation program by typing "route" at the user prompt. The 
user will be prompted for the start coordinate from which the 
program will generate a route that will be contained in a DOS 
text file called " route. fil." 
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V. CONCLUSION 



A. SUMMARY OF FINDINGS 

The purpose of this thesis was to (1) search for the best 
neural network architecture for generating tank routes, and 
(2) develop a prototype for route generation. Our findings 
suggested a 3 layer network with 10 hidden neurons that seems 
to produce the best reproduction of actual routes. The input 
and output layers will both consist of 2 neurons and the 
hidden layer will consist of 10 neurons. The network is to be 
trained to 95 percent. Also, in Chapter IV, we described the 
architecture of the prototype. 

B. RECOMMENDATIONS FOR FURTHER RESEARCH 

The findings of this thesis suggest the following 
recommendations for further research: 



• More automation and improvements of the prototype so that 
it is more user friendly. The prototype presented in this 
work should be refined to completely automate network 
training and route generation. The user should be 
required to do little more than input start positions for 
routes . 

• Testing with more tank battle scenario data. In addition 
to different battle scenarios, we suggest using various 
numbers of routes for training and then evaluating the 
program's effectiveness. We conducted some preliminary 
tests using as few as 4 routes for training and generated 
some reasonable route replications. 
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• Integration with other modules of the SEAS. For example, 
another module in the SEAS should produce the data file 
needed by the route determination module for training a 
network. The routes generated by the route determination 
module will be used by other modules of the system. The 
entire SEAS will automate many processes currently 
performed by human operators . 
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APPENDIX A 



TANK ROUTE RESEARCH DATA 
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97675 
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APPENDIX B 



PROTOTYPE OPERATING INSTRUCTIONS 



REQUIREMENTS : 

BrainMaker Professional software sold by California 
Scientific Software (not provided with thesis) 

- Prototype Diskette (included with thesis) 

- MS-DOS based computer with hard drive 

GETTING STARTED: 

1. Install BrainMaker software on computer hard drive. 

2 . Copy all prototype diskette files into the BrainMaker 
directory and change to this directory. 

TRAINING A NETWORK 

1. Create a BrainMaker Definition file by typing "NETMAKER 
filename" at the DOS prompt. Filename is the name of the file 
containing the route data. We included the data used in this 
thesis (modified as described in Chapter IV, Section A) in a 
file called data.txt. For example, type "NETMAKER DATA.TXT" 
to create a definition file from this data. 

Within the NetMaker program: 

2. Set test file percentage to zero (0) . 

3. Within the NetMaker program, label the columns, in order, 
X, Y, NEXTX AND NEXTY. 

4. Classify the first two columns as "basis" and the second 
two columns as "result." 

5. Save your definition file as "brainrts .def " and choose the 
"Go to BrainMaker" option from the menu. 

Within the BrainMaker program: 

6. Set training percentage to ninety-five (95). 

7. Select the "Train Network" option from the menu. 

8. After the program trains the network, save the network as 
"brainrts.net" and exit brainmaker. 
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GENERATING ROUTES: 



1. Start the route generating program by typing "route" at 
the DOS prompt . 

2. Type in the x coordinate of desired start position when 
prompted. For example, 55.790 if you desire 55790. 

3 . Type in the y coordinate of desired start position when 
prompted. For example, 99.45 for 99450. 

4. The program will display the start position (for example 
55.79 and 99.45) and ask you to verify them. Type "y" and 
press enter if they are correct and "n" and enter if you wish 
to change them. 

5. When you verify the information is correct, the program 
will inform you that it is about to generate a route and that 
you must stop the program by pressing Ctrl-Break when the 
displayed coordinates start to repeat. 

6. The generated route is saved in a file named route. fil. 
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